Implicit Modeling - A Generalization of Discriminative and Generative Approaches
نویسندگان
چکیده
We propose a new modeling approach that is a generalization of gen-erative and discriminative models. The core idea is to use an implicitparameterization of a joint probability distribution by specifying only theconditional distributions. The proposed scheme combines the advantagesof both worlds – it can use powerful complex discriminative models asits parts, having at the same time better generalization capabilities. Wethoroughly evaluate the proposed method for a simple classification taskwith artificial data and illustrate its advantages for real-word scenarios ona semantic image segmentation problem.
منابع مشابه
Generative and discriminative algorithms for spoken language understanding
Spoken Language Understanding (SLU) for conversational systems (SDS) aims at extracting concept and their relations from spontaneous speech. Previous approaches to SLU have modeled concept relations as stochastic semantic networks ranging from generative approach to discriminative. As spoken dialog systems complexity increases, SLU needs to perform understanding based on a richer set of feature...
متن کاملOpen Domain Short Text Conceptualization: A Generative + Descriptive Modeling Approach
Concepts embody the knowledge to facilitate our cognitive processes of learning. Mapping short texts to a large set of open domain concepts has gained many successful applications. In this paper, we unify the existing conceptualization methods from a Bayesian perspective, and discuss the three modeling approaches: descriptive, generative, and discriminative models. Motivated by the discussion o...
متن کاملQuantitative modeling of the neural representation of objects: How semantic feature norms can account for fMRI activation
Recent multivariate analyses of fMRI activation have shown that discriminative classifiers such as Support Vector Machines (SVM) are capable of decoding fMRI-sensed neural states associated with the visual presentation of categories of various objects. However, the lack of a generative model of neural activity limits the generality of these discriminative classifiers for understanding the under...
متن کاملDifferential Use of Implicit Negative Evidence in Generative and Discriminative Language Learning
A classic debate in cognitive science revolves around understanding how children learn complex linguistic rules, such as those governing restrictions on verb alternations, without negative evidence. Traditionally, formal learnability arguments have been used to claim that such learning is impossible without the aid of innate language-specific knowledge. However, recently, researchers have shown...
متن کاملBayesian approaches in Natural Language Processing
This paper overviews Bayesian approaches in natural language processing that are becoming prominent. Without any knowledge of natural language processing, Bayesian approaches to both discriminative learning and generative modeling are described. Especially, näıve bayes and its full unsupervised Bayesian modeling, DM, and LDA are developed. These Bayesian approaches permit interesting joint mode...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1612.01397 شماره
صفحات -
تاریخ انتشار 2016